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SYSTEM AND METHOD FOR 
DYNAMIC AUTOCROPPING OF IMAGES 

Field of the Invention 

The present invention relates to the field of computer graphics, compositing images, 
and adding special effects to images. 

Background 

5 Color images are defined by many pixels. Pixels are the building blocks of an 

image and are often defined by a three component description comprised of red, green and 
blue components commonly referred to as RGB. A fourth component called alpha is often 
added resulting in an RGB A description of pixels. Alpha refers to the opacity (or 
transparency) of a pixel. The standard alpha component is an eight bit value providing 256 

10 levels of opacity from 0-255, where 0 is fully transparent and 255 is full opacity amounting 
to non-transparency. Alpha is popularly used in compositing images for feature films and 
other video presentations. 

Compositing images is the combining of more than one image to create a single new 
image. Compositing of images can be performed with a single image frame, such as 

1 5 photograph or a sequence of images, such as film or movies. For example an image of a 
fish could be combined with the image of a grassy field so that the fish is swimming in the 
grass. Alpha is used to relate the fish image to the grass. For example, if the fish is placed 
on the grass and the grass is completely opaque (alpha = 255), no grass will be seen 
through the fish. If the fish has an alpha of 0, the grass image will seep through the fish so 

20 that the fish cannot be seen. Alpha values in between produce differing degrees of a grassy 
fish. A fish swimming through the grass could be created by compositing a single image 
frame of a grassy field and a sequence of images created by filming a fish swimming in the 
ocean. Alternatively, two (or more) sequences of images can be composited, such as a 
sequence of images of a wind blown grassy field and a sequence of images of a school of 

25 fish swimming through the ocean. In addition, the school of fish and/or the grassy field 

can also have been created in an animation program. Moreover, the ocean area surrounding 
filmed fish could be obliterated by giving the surroundings (that is, everything but the fish) 
an opacity of 0, setting the surroundings to have no opacity. 

Compositing also includes the techniques of enhancing a sequence of images 

30 captured on film by adding special effects, computer generated images, still images, 

animation and other filmed images to a motion picture. Compositing is used to enhance a 
sequence of film thus creating a new sequence of images. Special effects, computer 
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generated images, still images, animation and other filmed images are combined with film 
by compositing to create a new sequence of images. 

One popular use for compositing includes the use of blue screen image sequences. 
In what is known as "blue screening," an actor is filmed in front of a blue (or green) 

5 screen. The alpha values of the background in such an image can be automatically set to 
transparent, having an opacity of 0. The blue screened sequence of images is then 
composited with other sequences of images. For example, a street vendor selling watches 
shot against a blue screen could be composited with a city street scene with English 
language signs behind him to create one sequence of image, while the same vendor 

1 0 sequence could be composited with Spanish language signs at one of Spain' s costa del sol 
beach resorts to create a second sequence of images. More striking effects such as 
compositing sequences of images to show an actor riding a prehistoric dinosaur can be 
achieved in a similar manner. 
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SUMMARY 

The present invention provides a system and method for automatically reading a 
plurality of images from sequences of images from a specified location, automatically 
cropping each of the images to produce active region data for the current image, and 
5 automatically designating key frames in the sequences of images. In one embodiment, a 
stand-alone program that achieves these tasks produces an output file comprised of active 
region data for key frames of all sequences of images. In such an embodiment, the output 
file serves as a script or control file which a compositing program runs to initially process 
sequences of images. In another embodiment, these automatic tasks are achieved via a 

10 plug-in module to a compositing program such that the plug-in module is run before 

performing other tasks. The automation of these three formerly manual tasks increases the 
efficiency of compositing programs by providing automatically pre-processed sequences of 
images from which to start the compositing process. In addition, autocropping allows for 
better use of system resources and improves system performance by causing the system to 

1 5 only load smaller, autocropped images of key frames. 
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BRIEF DESCRIPTION OF THE DRAWINGS 



The features and advantages of the present invention will become apparent from the 
following detailed description of the present invention in which: 

Figure 1 depicts a system and environment in which the method of the present 
5 invention is executed. 

Figure 2 depicts the flow of initial steps automatically performed according to the 
method of the present invention when starting to create a video presentation with 
compositing software applications. 

Figure 3 depicts a more detailed view of the flow of one embodiment of the initial 
10 steps automatically performed according to the method of the present invention when 
starting to create a video presentation with a compositing software application. 

Figures 4a and 4b depict two methods of embodiments of autocropping. 
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DETAILED DESCRIPTION 

When creating a movie, sequences of images are traditionally shot with a camera, 
developed and edited to create a finished product. Special effects have been added to films 
in many ways. More recently, with the availability of high powered computers, computer 
software programs are increasingly used to assist in the creation of movies, television 
shows, and other video presentations whether originating from animation or live action 
camera shots. To clarify various qualities of the present invention, the phrase video 
presentation includes sequences of images such as film, movies, animation, features, 
shorts, and the like created by digital film or video footage, digitized film or video input, 
computer generated images, hand drawn images, still images such as photographs and the 
compositing of each of these including the adding of effects. In addition, the phrase 
sequence of images includes any sequence of images created by filming, videotaping, still 
photography, computer generated images such as animation, hand drawn images such as 
animation, and the like. 

Computer programs used in manipulating sequences of images for producing video 
presentations are compositing programs commonly referred to as effects software or digital 
effects software. Examples of such programs include Media Illusion® available from the 
Softimage™ division of Avid Technology, Inc., One Park West, Tewksbury, 
Massachusetts 01876; Chalice, available from Silicon Grail Corporation, 710 Seward 
Street, Hollywood, California 90038, and the Maya and Studio series of programs, 
available from Alias|Wavefront®, 210 King Street East, Toronto, Ontario, Canada M5A 
1J7. 

When starting to use a compositing program, sequences of images stored in a 
variety of formats are input. Common formats of digital images used in producing video 
presentations include Alias] Wavefront's RLA format (more information is available from 
Alias|Wavefront®, 210 King Street East, Toronto, Ontario, Canada M5A 1J7), Silicon 
Graphic's SGI format (more information is available from Silicon Graphics, Inc., 1600 
Amphitheatre Parkway, Mountain View, California 94043), and Kodak's Cineon digital 
film format (more information is available from Eastman Kodak Company, Rochester, 
New York). 

Figure 1 depicts a system and environment in which the method of the present 
invention is executed. A compositing program is executed on computer 1. The computer 
comprises a processor 2 to execute the compositing program. Processor 2 may be any 
computer processor known to those skilled in the art. When executing the compositing 
program, the processor utilizes memory 3. Memory 3 may be any form of volatile random 
access memory (RAM) known to those skilled in the art. The compositing program 
accesses sequences of images from storage device 4. Storage device 4 may be a writeable 
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disk drive known to those skilled in the art such as, for example, a hard disk or a readable 
and writeable compact disk (CDRW). When the compositing program reads an image or 
sequence of images from the disk drive, the processor may communicate instructions to 
graphics controller 5 to display the images on display device 6. Graphics controller 6 may 
5 be any graphics controller known to those skilled in the art, and display device 6 may be 
any display monitor known to those skilled in the art, including, but not limited to, a 
cathode ray tube (CRT) display monitor, or thin film transistor (TFT) display screen. A 
user accesses the compositing program running on computer 1 via any computer input 
device known to those skilled in the art, such as, for example keyboard 7 and mouse 8 

10 which are coupled to the processor by an input/output (I/O) controller 9. 

To access images not stored on computer 1, computer 1 includes a network access 
unit 10 which allows the compositing program to communicate over network 14 to remote 
computer 15 and access images stored on remote storage device 16. Network 14 may be a 
local area network (LAN), wide area network (WAN), or any other kind of network known 

1 5 to those skilled in the art. Remote computer 15 may be any kind of computer known to 

those skilled in the art, including, but not limited to, personal computers, specialty graphics 
workstations, and servers. Remote storage device 16 may be any readable storage medium 
known to those skilled in the art such as, for example, hard disk drives and CDRWs. 
Although only one remote computer and one network are depicted, multiple remote 

20 computers over multiple networks may be connected to computer 1. Processor 2, memory 
3, storage device 4, graphics controller 5, I/O controller 9 and network access unit 10, are 
coupled to one another via and communicate with one another over bus 1 1. Bus 1 1 may be 
any bus known to those skilled in the art. Although only one bus is depicted, multiple 
buses may be used in computer 1. In addition, other internal components known to those 

25 skilled in the art (not depicted) or multiple instances of depicted components may be 
included in computer 1. 

The initial steps taken when using compositing programs typically include a user 
manually designating each sequence of images that will be combined. The user then often 
manually crops images and manually selects what is known in the art as key frames, single 

30 images of a sequence of images that meet certain criteria. Key frames are image frames of a 
sequence of images which are important to the sequence of images and include the first 
image of a sequence of images, and image frames which are substantially different from the 
prior image frame. Key frames are discussed in more detail below. 

Figure 2 depicts the flow of initial steps automatically performed according to one 

3 5 embodiment of the method of the present invention when starting to create a video 

presentation with a compositing software application. The present invention provides a 
method for automatically reading images from sequences of images from a specified 
directory or directories as shown in block 20, automatically cropping each of the images as 
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shown in block 22, and automatically designating key frames in the sequences of images 
as shown in block 24. The automation of these three formerly manual tasks increases the 
efficiency of users of compositing programs by providing automatically pre-processed 
sequences of images from which to start. In addition, autocropping allows for better use of 
5 system resources and improves system performance by causing the system to only load 
autocropped images of key frames. This increased performance is achieved by the system 
loading fewer images, only key frames rather than all image frames of a sequence of 
images, and only loading the autocropped key frames which are smaller than full images. 
That is, as a cropped image is smaller, comprises a smaller area, it is defined by less data 

10 than a full image. 

Software written to automatically read sequences of images, automatically crop the 
images, and automatically designate key frames may be implemented a variety of ways. In 
one embodiment, the software is implemented as a plug-in or a module within a 
compositing program. In an alternate embodiment, the software may be implemented as a 

1 5 stand-alone pre-processing tool or utility program. In one embodiment, the automatic 
cropping and other steps can be included as a plug-in or module with a compositing 
program such that the plug-in is executed upon start up of the compositing program or is 
executed as a first step when using the compositing program. In another embodiment, the 
automatic cropping and other steps can be achieved via a separate stand-alone program 

20 which is run in advance of starting a compositing program such that the stand-alone 
program creates a script or control file which the compositing program runs to initially 
process sequences of images. In such an embodiment, the stand-alone program functions 
as a pre-processing program that is run on sequences of images before a user begins using 
the features of the compositing program. 

25 Figure 3 depicts a more detailed view of the flow of initial steps automatically 

performed according to one embodiment of the method of the present invention when 
starting to create a video presentation with a compositing software application. In one 
embodiment, to automatically read sequences of images, automatically crop the images, and 
automatically designate key frames, a stand-alone pre-processing program is evoked via a 

30 command line interface taking various parameters as input. In one embodiment, parameters 
include boundary, a smoothness factor, input file location, output file location. (Boundary 
and smoothness factor are discussed in more detail below.) The input parameters are 
obtained as shown in step 30. The first image of the first sequence of images in the 
specified directory is then read and set as the current image as shown in block 32. The 

35 current image is then autocropped, as shown in block 38, producing active region data for 
the current image. In one embodiment, during autocropping, only cropping data, that is, 
active region data, is produced; in this embodiment, no changes are made to the current 
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image during autocroppihg. Further details of one embodiment of autocropping are set 
forth below with regard to Figures 4a and 4b. 

After autocropping the current image, a user specified boundary, if any, is added to 
the active region of the current image, as shown in block 40. As with autocropping, no 
5 changes are made to the current image; only the active region data is updated. In another 
embodiment, a default or machine preset boundary, or no boundary is added to the active 
region. In one embodiment, the pre-processing software allows the user to set the 
boundary to between 0 and 20 pixels, and defaults to a boundary of 10 pixels if no 
boundary value is specified. 

1 o A check is then made to determine whether the current image is a first image of the 

current sequence of images, as shown in block 42. If the current image is a first image, the 
current image is designated as a key frame, as shown in block 48. If the current image is 
not a first image, a check is made to determine whether the active region of the current 
image is inside the prior image's active region, as shown in block 44. If not, the current 

1 5 image is designated as a key frame, as shown in block 48. If the active region of the 
current image is inside the prior image's active region, a comparison is then made to 
determine if smoothing is needed, as shown in block 46. 

Smoothing relates to how different the image frames are from their neighboring 
image frames in a particular sequence of image frames. More specifically, when a 

20 sequence of images is displayed over time, the resulting viewed images can appear smooth 
or disjointed depending on how similar the image frames comprising the sequence are to 
one another. The smoothing factor is a value representing the threshold by which one 
frame can differ from its neighbors. In one embodiment, smoothing is needed when the 
difference in area (in square pixels) between the active region of the current image and the 

25 active region of the prior image is greater than the smoothing factor value input by the user. 
If smoothing is needed, then the current image is designated a key frame, as shown in 
block 48. In another embodiment, a default or machine preset smoothing factor, or no 
smoothing factor is provided. In one embodiment, the pre-processing software allows the 
user to set the smoothing factor to between 0 and 20 pixels, and defaults to a smoothing 

30 factor of 5 pixels if no smoothing factor value is specified. 

If the current image is a first image, if the active region of the current image is not 
inside the prior image's active region, or if smoothing is needed, the current frame is 
designated as a key frame, as shown in block 48. If the current image is a key frame, the 
active region data for the current frame is stored so that it is later included in the output file 

3 5 when pre-processing has completed. The output file only contains active region data for 
images designated as key frames. 

If smoothing is not needed or after the current image has been designated a key 
frame, a check is made as to whether there are any further images; that is, a check is made 
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as to whether there is a "next image, as shown in block 50. As part of this checking, if there 
is a next image, the next image is read. Reading the next image includes, storing the 
current image and its active region data as the prior image and active region of the prior 
image, and reading the next image of the current sequence of images and setting it to be the 
5 current image. As this point, if there are no further images in the current sequence of 

images, the next sequence of images is obtained from the user specified directory. If there 
is a next image, autocropping is performed at block 38, and the flow continues as 
previously described. If there are no further images in the current sequence of images and 
there are no further sequences of images, then an output file is prepared containing data that 

1 0 defines the active regions for all of the images of all of the sequences of images that were 
designated as key frames, as shown in block 60. The output file can then be used as an 
input file to a compositing program. 

Figures 4a and 4b depict two methods of autocropping. Generally, 
autocropping determines the active region of a current image frame. In one embodiment, an 

1 5 active region is a region surrounded by pixels that are fully transparent or pixels that have 
no opacity. In other embodiments, an active region is a region surrounded by pixels that 
are outside a certain opacity threshold that may be either pre-defined by the system or user 
defined. In yet other embodiments, a determination of opacity for a pixel is made by 
analyzing pixels surrounding the current pixel to create an average which is then compared 

20 to a threshold opacity. In such embodiments, a function that returns 0 when the pixel is 
within the threshold opacity and 1 when the pixel is outside the threshold opacity may be 
used. Such a function would, in some embodiments take into consideration the opacity 
values of pixels neighboring the current pixel. Traditionally, opacity is an 8 bit value, but 
in other embodiments, opacity may be an alpha component that is a 16 bit, 32 bit, 64 bit or 

25 any other bit size variable the particular hardware system supports. In addition, in other 
embodiments, it follows that opacity as measured by an alpha value may increase in range 
from 0 to 255 to a range correlating to the bit size used to represent alpha values, such as, 
for example, 0 to 65,536 for a 16 bit representation. 

Figure 4a depicts one method of autocropping an image frame. After the current 

30 image is read, as shown in block 70, the left-most vertical line of the current image with 

opacity is located, as shown in block 72. In one embodiment, this is achieved by starting at 
pixel 0,0, the origin of the image, and proceeding up and down vertical lines to the right 
until a line with opacity is found such that the prior line has no opacity. The x coordinate of 
the left-most vertical line with opacity defines the left border of the active region of the 

3 5 current image. Similarly, the right-most vertical line of the current image with opacity is 
located, as shown in block 74. In one embodiment, this is achieved by starting at the pixel 
corresponding to the horizontal and vertical resolution of the image (e.g., pixel 800, 600 
for an image frame with 800 x 600 resolution) and proceeding down and up vertical lines to 
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the left (no further than the left border) until a line with opacity is found such that the prior 
line has no opacity. The x coordinate of the right-most vertical line with opacity defines the 
right border of the active region of the current image. 

The top and bottom borders of the active region of the current image are then 
5 located. The top-most horizontal line of the current image with opacity is located, as shown 
in block 76. In one embodiment, this is achieved by starting at the pixel with the x 
coordinate corresponding to the left border and the y coordinate corresponding to the image 
vertical resolution {e.g., pixel left border, 600 for an image frame with 800 x 600 
resolution) and proceeding left and right across horizontal lines between the left border and 
1 0 right border toward the bottom until a line with opacity is found such that the prior line has 
no opacity. Processing pixels between the left border and right border increases 
computational efficiency as pixels outside the borders are not examined. The y coordinate 
of the top-most horizontal line with opacity defines the top border of the active region of the 
current image. 

15 The bottom-most horizontal line of the current image with opacity is then located, as 

shown in block 78. In one embodiment, this is achieved by starting at the pixel with the x 
coordinate corresponding to the left border and the y coordinate corresponding to 0 (i.e., 
pixel left border, 0) and proceeding left and right across horizontal lines between the left 
border and right border toward the top border until a line with opacity is found such that the 

20 prior line has no opacity. As above, processing pixels between the left border and right 

border increases computational efficiency. The y coordinate of the bottom-most horizontal 
line with opacity defines the bottom border of the active region of the current image. 

Data representing the active region of the current image is then stored, as shown in 
block 80. The data stored are the left border, right border, top border and bottom borders 

25 of the active region of the current image. 

Figure 4b depicts another method of autocropping an image frame. After the 
current image is read, as shown in block 90, the top-most horizontal line of the current 
image with opacity is located, as shown in block 92. In one embodiment, this is achieved 
by starting at the pixel with an x coordinate corresponding to 0 and a y coordinate 

30 corresponding to the vertical resolution of the image (e.g., 0, 600 for an image frame with 
800 x 600 resolution) and proceeding right and left across horizontal lines toward the 
bottom until a line with opacity is found such that the prior line has no opacity. The y 
coordinate of the top-most horizontal line with opacity defines the top border of the active 
region of the current image. Similarly, the bottom-most horizontal line of the current image 

35 with opacity is located, as shown in block 94. In one embodiment, this is achieved by 

starting at the pixel corresponding to coordinates 0, 0 and proceeding right and left across 
horizontal lines toward the top (no further than the top border) until a line with opacity is 
found such that the prior line has no opacity. The y coordinate of the bottom-most 
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horizontal line with opacity defines the bottom border of the active region of the current 
image. 

The left and right borders of the active region of the current image are then located. 
The left-most vertical line of the current image with opacity is located, as shown in block 
5 96. In one embodiment, this is achieved by starting at the pixel with x coordinate 

corresponding to 0 and y coordinate corresponding to the bottom border (i.e., pixel at 0, 
bottom border) and proceeding up and down through vertical lines between the bottom 
border and top border to the right until a line with opacity is found such that the prior line 
has no opacity. Processing pixels between the bottom border and top border increases 
10 computational efficiency as pixels outside the borders are not examined. The x coordinate 
of the left-most vertical line with opacity defines the left border of the active region of the 
current image. 

The right-most vertical line of the current image with opacity is then located, as 
shown in block 98. In one embodiment, this is achieved by starting at the pixel with the x 

1 5 coordinate corresponding to the horizontal resolution of the image and the y coordinate 
corresponding to the bottom border (e.g., pixel 800, bottom border for an image frame 
with 800 x 600 resolution) and proceeding up and down through vertical lines between the 
bottom border and top border toward the left border until a line with opacity is found such 
that the prior line has no opacity. As above, processing pixels between the top border and 

20 bottom border increases computational efficiency. The x coordinate of the right-most 
horizontal line with opacity defines the right border of the active region of the current 
image. 

Data representing the active region of the current image is then stored, as shown in 
block 100. The data stored are the left border, right border, top border and bottom borders 
25 of the active region of the current image. 

While certain exemplary embodiments have been described and shown in the 
accompanying drawings, it is to be understood that such embodiments are merely 
illustrative of and not restrictive on the broad invention, and that this invention not be 
limited to the specific constructions and arrangements shown and described, since various 
3 0 other modifications may occur to those ordinarily skilled in the art. 
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CLAIMS 

What is claimed is: 

1 1 . A method comprising: 

2 reading at least one sequence of images; 

3 preparing autocrop data for each image of each of the sequences of images; and 

4 storing autocrop data for each key frame of the sequences of images. 

1 2 . The method of Claim 1 wherein preparing autocrop data comprises: 

2 determining the active region of a current image of the sequences of images. 

1 3 . The method of Claim 2 wherein determining the active region comprises : 

2 selecting a portion of the current image as the active region of the current image 

3 such that all pixels outside the active region have no opacity. 

1 4 . The method of Claim 3 wherein selecting a portion comprises: 

2 reading the current image; 

3 locating a first vertical line of pixels with at least one pixel having non-zero opacity 

4 closest to the origin of the image; 

5 locating a second vertical line of pixels with at least one pixel having non-zero 

6 opacity furthest from the origin of the image; 

7 locating a first horizontal line of pixels with at least one pixel having non-zero 

8 opacity closest to the origin of the image; 

9 locating a second horizontal line of pixels with at least one pixel having non-zero 

10 opacity furthest from the origin of the image; and 

1 1 storing data specifying the active region of the current image. 

1 5 . The method of Claim 4 wherein 

2 locating the first vertical line and locating the second vertical line are performed 

3 before locating the first horizontal line and locating the second horizontal line; and 

4 locating the first horizontal line and locating the second horizontal line each 

5 comprise examining pixels between the first vertical line and the second vertical line. 

1 6 . The method of Claim 4 wherein 

2 locating the first horizontal line and locating the second horizontal line are 

3 performed before locating the first vertical line and locating the second vertical line; and 

4 locating the first vertical line and locating the second vertical line each comprise 

5 examining pixels between the first horizontal line and the second horizontal line. 

12 
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1 7 . The method of Claim 4 wherein storing data specifying the active region of 

2 the current image comprises: 

3 storing the x coordinate of the first vertical line, the x coordinate of the second 

4 vertical line, the y coordinate of the first horizontal line, and the y coordinate of the second 

5 horizontal line. 

1 8 . The method of Claim 1 further comprising: 

2 determining which images of each of the sequences of images are key frames. 

1 9 . The method of Claim 8 wherein determining comprises: 

2 determining whether the current image is the first frame of one of the sequences of 

3 images, and, if so, designating the current image as a key frame; 

4 determining whether the active region of the current image is outside the active 

5 region of a prior image, and, if so, designating the current image as a key frame; and 

6 determining whether smoothing is needed, and, if so, designating the current image 

7 as a key frame. 

1 10. The method of Claim 9 wherein determining whether smoothing is needed 

2 comprises: 

3 calculating the difference in area between the active region of the current image and 

4 the active region of the prior image; and 

5 comparing the difference in area with a smoothing factor. 

1 11. The method of Claim 10 wherein the smoothing factor is a numerical value 

2 set by a user. 

1 12. The method of Claim 9 wherein the active region is a portion of any image 

2 such that all pixels outside the active region of the image have no opacity. 

1 13. The method of Claim 2 further comprising: 

2 adding a boundary to the active region of the current image. 

1 14. The method of Claim 1 3 wherein the boundary is a numerical value set by a 

2 user. 
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1 1 5 . A machine readable medium having stored thereon instructions which when 

2 executed by a processor cause the machine to perform operations comprising: 

3 reading at least one sequence of images; 

4 preparing autocrop data for each image of each of the sequences of images; and 

5 storing autocrop data for each key frame of the sequences of images. 

1 16. The machine readable medium of Claim 15 wherein preparing autocrop data 

2 causes the machine to perform operations comprising: 

3 determining the active region of a current image of the sequences of images. 

1 17. The machine readable medium of Claim 16 wherein determining the active 

2 region data causes the machine to perform operations comprising: 

3 selecting a portion of the current image as the active region of the current image 

4 such that all pixels outside the active region have no opacity. 

1 18. The machine readable medium of Claim 17 wherein selecting a portion 

2 causes the machine to perform operations comprising: 

3 reading the current image; 

4 locating a first vertical line of pixels with at least one pixel having non-zero opacity 

5 closest to the origin of the image; 

6 locating a second vertical line of pixels with at least one pixel having non-zero 

7 opacity furthest from the origin of the image; 

8 locating a first horizontal line of pixels with at least one pixel having non-zero 

9 opacity closest to the origin of the image; 

1 0 locating a second horizontal line of pixels with at least one pixel having non-zero 

1 1 opacity furthest from the origin of the image; and 

1 2 storing data specifying the active region of the current image. 

1 19. The machine readable medium of Claim 18 wherein: 

2 locating the first vertical line and locating the second vertical line are performed 

3 before locating the first horizontal line and locating the second horizontal line; and 

4 locating the first horizontal line and locating the second horizontal line each 

5 comprise examining pixels between the first vertical line and the second vertical line. 
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1 20 . The machine readable medium of Claim 1 8 wherein: 

2 locating the first horizontal line and locating the second horizontal line are 

3 performed before locating the first vertical line and locating the second vertical line; and 

4 locating the first vertical line and locating the second vertical line each comprise 

5 examining pixels between the first horizontal line and the second horizontal line. 

1 21. The machine readable medium of Claim 1 8 wherein storing data specifying 

2 the active region of the current image causes the machine to perform operations comprising: 

3 storing the x coordinate of the first vertical line, the x coordinate of the second 

4 vertical line, the y coordinate of the first horizontal line, and the y coordinate of the second 

5 horizontal line. 

1 22. The machine readable medium of Claim 15 having stored thereon further 

2 instructions which when executed by the processor cause the machine to perform further 

3 operations comprising: 

4 determining which images of each of the sequences of images are key frames. 

1 23. The machine readable medium of Claim 22 wherein determining causes the 

2 machine to perform operations comprising: 

3 determining whether the current image is the first frame of one of the sequences of 

4 images, and, if so, designating the current image as a key frame; 

5 determining whether the active region of the current image is outside the active 

6 region of a prior image, and, if so, designating the current image as a key frame; and 

7 determining whether smoothing is needed, and, if so, designating the current image 

8 as a key frame. 

1 24 . The machine readable medium of Claim 23 wherein determining whether 

2 smoothing is needed causes the machine to perform operations comprising: 

3 calculating the difference in area between the active region of the current image and 

4 the active region of the prior image; and 

5 comparing the difference in area with a smoothing factor. 

1 25 . The machine readable medium of Claim 24 wherein the smoothing factor is 

2 a numerical value set by a user. 

1 26. The machine readable medium of Claim 23 wherein the active region is a 

2 portion of any image such that all pixels outside the active region of the image have no 

3 opacity. 
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1 27 . The machine readable medium of Claim 16 having stored thereon further 

2 instructions which when executed by the processor cause the machine to perform further 

3 operations comprising: 

4 adding a boundary to the active region of the current image. 

1 28. The machine readable medium of Claim 13 wherein the boundary is a 

2 numerical value set by a user. 

1 29. A system comprising: 

2 a processor coupled to a bus; 

3 a memory coupled to the bus; 

4 a storage device coupled to the bus, the storage device having stored thereon 

5 instructions which when executed by the processor cause the system to perform operations 

6 comprising: 

7 reading at least one sequence of images; 

8 preparing autocrop data for each image of each of the sequences of images; 

9 and 

1 0 storing autocrop data for each key frame of the sequences of images 

1 1 on the storage device. 

1 30. The system of Claim 29 wherein preparing autocrop data causes the system 

2 to perform operations comprising: 

3 determining the active region of a current image of the sequences of images. 

1 31. The system of Claim 30 wherein determining the active region data causes 

2 the system to perform operations comprising: 

3 selecting a portion of the current image as the active region of the current image 

4 such that all pixels outside the active region have no opacity. 

1 32. The system of Claim 3 1 wherein selecting a portion causes the system to 

2 perform operations comprising: 

3 reading the current image; 

4 locating a first vertical line of pixels with at least one pixel having non-zero opacity 

5 closest to the origin of the image; 

6 locating a second vertical line of pixels with at least one pixel having non-zero 

7 opacity furthest from the origin of the image; 

8 locating a first horizontal line of pixels with at least one pixel having non-zero 

9 opacity closest to the origin of the image; 
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1 0 locating a second horizontal line of pixels with at least one pixel having non-zero 

1 1 opacity furthest from the origin of the image; and 

12 storing data specifying the active region of the current image. 

1 33. The system of Claim 3 2 wherein : 

2 locating the first vertical line and locating the second vertical line are performed 

3 before locating the first horizontal line and locating the second horizontal line; and 

4 locating the first horizontal line and locating the second horizontal line each 

5 comprise examining pixels between the first vertical line and the second vertical line. 

1 34. The system of Claim 32 wherein: 

2 locating the first horizontal line and locating the second horizontal line are 

3 performed before locating the first vertical line and locating the second vertical line; and 

4 locating the first vertical line and locating the second vertical line each comprise 

5 examining pixels between the first horizontal line and the second horizontal line. 

1 35 . The system of Claim 32 wherein storing data specifying the active region of 

2 the current image causes the system to perform operations comprising: 

3 storing the x coordinate of the first vertical line, the x coordinate of the second 

4 vertical line, the y coordinate of the first horizontal line, and the y coordinate of the second 

5 horizontal line. 

1 36. The system of Claim 29 having further instructions which when executed by 

2 the processor cause the system to perform further operations comprising: 

3 determining which images of each of the sequences of images are key frames. 

1 37. The system of Claim 36 wherein determining causes the system to perform 

2 operations comprising: 

3 determining whether the current image is the first frame of one of the sequences of 

4 images, and, if so, designating the current image as a key frame; 

5 determining whether the active region of the current image is outside the active 

6 region of a prior image, and, if so, designating the current image as a key frame; and 

7 determining whether smoothing is needed, and, if so, designating the current image 

8 as a key frame. 

1 38. The system of Claim 37 wherein determining whether smoothing is needed 

2 causes the system to perform operations comprising: 
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3 calculating the difference in area between the active region of the current image and 

4 the active region of the prior image; and 

5 comparing the difference in area with a smoothing factor. 

1 39. The system of Claim 37 wherein the active region is a portion of any image 

2 such that all pixels outside the active region of the image have no opacity. 

1 40. The system of Claim 39 having stored thereon further instructions which 

2 when executed by the processor cause the system to perform further operations comprising: 

3 adding a boundary to the active region of the current image. 

1 41. The system of Claim 29 wherein reading at least one sequence of images 

2 comprises: 

3 transferring at least one sequence of images from the storage device to the memory. 

1 42. The system of Claim 29 wherein reading at least one sequence of images 

2 comprises: 

3 transferring at least one sequence of images from a remote storage device via a 

4 network. 
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ABSTRACT 

A system and method for automatically reading all images from all sequences of 
images from a specified location, automatically cropping each of the images to produce 
active region data for the current image, and automatically designating key frames in the 
5 sequences of images. In one embodiment, a stand-alone program that achieves these tasks 
produces an output file comprised of active region data for key frames of all sequences of 
images. In such an embodiment, the output file serves as a script or control file which a 
compositing program runs to initially process sequences of images. In another 
embodiment, these automatic tasks are achieved via a plug-in module to a compositing 

10 program such that the plug-in module is run before performing other tasks. The automation 
of these three formerly manual tasks increases the efficiency of compositing programs by 
providing automatically pre-processed sequences of images from which to start the 
compositing process. In addition, autocropping allows for better use of system resources 
and improves system performance by causing the system to only load smaller, autocropped 

1 5 images of key frames. 
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APPENDIX B 



Title 37, Code of Federal Regulations, Section 1.56 
Duty to Disclose Information Material to Patentability 

(a) A patent by its very nature is affected with a public interest. The public interest is best served, 
and the most effective patent examination occurs when, at the time an application is being examined, the 
Office is aware of and evaluates the teachings of all information material to patentability. Each individual 
associated with the filing and prosecution of a patent application has a duty of candor and good faith in dealing 
with the Office, which includes a duty to disclose to the Office all information known to that individual to be 
material to patentability as defined in this section. The duty to disclosure information exists with respect to 
each pending claim until the claim is cancelled or withdrawn from consideration, or the application becomes 
abandoned. Information material to the patentability of a claim that is cancelled or withdrawn from 
consideration need not be submitted if the information is not material to the patentability of any claim remaining 
under consideration in the application. There is no duty to submit information which is not material to the 
patentability of any existing claim. The duty to disclosure all information known to be material to patentability 
is deemed to be satisfied if all information known to be material to patentability of any claim issued in a patent 
was cited by the Office or submitted to the Office in the manner prescribed by §§1 .97(b)-(d) and 1 .98. 
However, no patent will be granted on an application in connection with which fraud on the Office was practiced 
or attempted or the duty of disclosure was violated through bad faith or intentional misconduct. The Office 
encourages applicants to carefully examine: 

(1 ) Prior art cited in search reports of a foreign patent office in a counterpart application, and 

(2) The closest information over which individuals associated with the filing or prosecution of a 
patent application believe any pending claim patentably defines, to make sure that any material information 
contained therein is disclosed to the Office. 

(b) Under this section, information is material to patentability when it is not cumulative to 
information already of record or being made or record in the application, and 

(1 ) It establishes, by itself or in combination with other information, a prima facie case of 
unpatentability of a claim; or 

(2) It refutes, or is inconsistent with, a position the applicant takes in: 

(i) Opposing an argument of unpatentability relied on by the Office, or 

(ii) Asserting an argument of patentability. 

A prima facie case of unpatentability is established when the information compels a conclusion that a claim is 
unpatentable under the preponderance of evidence, burden-of-proof standard, giving each term in the claim its 
broadest reasonable construction consistent with the specification, and before any consideration is given to 
evidence which may be submitted in an attempt to establish a contrary conclusion of patentability. 

(c) Individuals associated with the filing or prosecution of a patent application within the 
meaning of this section are: 

(1 ) Each inventor named in the application; 

(2) Each attorney or agent who prepares or prosecutes the application; and 

(3) Every other person who is substantively involved in the preparation or prosecution of the 
application and who is associated with the inventor, with the assignee or with anyone to whom there is an 
obligation to assign the application. 

(d) Individuals other than the attorney, agent or inventor may comply with this section by 
disclosing information to the attorney, agent, or inventor. 
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